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Abstract]] 

We present a simple discrete model for the non-linear spatial interaction of different kinds of 
"subpopulations" composed of identical moving entities like particles, bacteria, individuals, 
etc. The model allows to mimic a variety of self-organized agglomeration and segregation 
phenomena. By relating it to game-theoretical ideas, it can be applied not only to attractive 
and repulsive interactions in physical and chemical systems, but also to the much richer 
combinations of positive and negative interactions found in biological and socio-economic 
systems. Apart from investigating symmetric interactions related to a continuous increase of 
the "overall success" within the system ("self-optimization"), we will focus on cases, where 
fluctuations further or induce self-organization, even though the initial conditions and the 
interactions are assumed homogeneous in space (translation invariant). 

Keywords: Self-organization, self-optimization, game theory, fluctuation- 
induced transition, agglomeration, segregation. 



1. Introduction modelled in a mathematical way. Reasons 

for this are the huge number of interacting 
Although the biological, social, and eco- variables, most of which cannot be quanti- 
nomic world are full of self-organization phe- hed, plus the assumed freedom of decision- 
nomena, many people believe that the dy- making or large fluctuations within biolog- 
namics behind them is too complex to be ical and socio-economic systems. However, 
in many situations, the living entities mak- 
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or less) optimal behavior, which can make 
the latter describable or predictable to a cer- 
tain extend []. This is even more the case 
for the behavior shown under certain con- 
straints like, for example, in pedestrian or 
vehicle dynamics [] . While pedestrians or ve- 
hicles can move freely at small traffic densi- 
ties, at large densities the interactions with 
the others and with the boundaries of the 
street confines them to a small spectrum of 
moving behaviors. Consequently, empirical 
traffic dynamics can be reproduced by sim- 
ulation models surprisingly well [] . 

In this connection, it is also interesting to 
mention some insights gained in statistical 
physics and complex systems theory: Non- 
linearly interacting variables do not change 
independently of each other, and in many 
cases there is a separation of the time scales 
on which they evolve. This often allows to 
"forget" about the vast number of rapidly 
changing variables, which are usually deter- 
mined by a small number of "order parame- 
ters" and treatable as fluctuations []. In the 
above mentioned examples of traffic dynam- 
ics, the order parameters are the traffic den- 
sity and the average velocity of pedestrians 
or vehicles. 

Another discovery is that, by proper 
transformations or scaling, many different 
models can by mapped onto each other, i.e. 
they behave basically the same []. That is, 
a certain class of models displays the same 
kinds of states, shows the same kinds of 
transitions among them, and can be de- 
scribed by the same "phase diagram", dis- 
playing the respective states as a function of 
some "control parameters" [] . We call such a 
class of models a "universality class" , since 
any of these models shows the same kind 
of "universal" behavior, i.e., the same phe- 
nomena. Consequently, one usually tries to 



find the simplest model having the proper- 
ties of the universality class. While physi- 
cists like to call it a "minimal model" , "pro- 
totype model" , or "toy model" , mathemati- 
cians named the corresponding mathemati- 
cal equations "normal forms" [] . 

Universal behavior is the reason of the 
great success of systems theory [] in com- 
paring phenomena in seemingly completely 
different systems, like physical, biological, or 
social ones. However, since these systems are 
composed of different entities and their cor- 
responding interactions can be considerably 
different, it is not always easy to identify 
the variables and parameters behind their 
dynamics. It can be helpful to take up game- 
theoretical ideas, here, quantifying interac- 
tions in terms of payoffs []. This can be 
applied to positive (profitable, constructive, 
cooperative, symbiotic) or negative (com- 
petitive, destructive) interactions in socio- 
economic or biological systems, but to at- 
tractive and repulsive interactions in physi- 
cal systems as well [] . 

In the following, we will investigate 
a simple model for interactive motion in 
space allowing to describe (i) various self- 
organized agglomeration phenomena, like 
settlement formation, and segregation phe- 
nomena, like ghetto formation, emerging 
from different kinds of interactions and 
(ii) fluctuation-induced ordering or self- 
organization phenomena. 

Noise-related phenomena can be quite 
surprising and have, therefore, recently at- 
tracted the interest of many researchers. For 
example, we mention stochastic resonance 
[], noise-driven motion [], and "freezing by 
heating" []. 

The issue of order through fluctuations 
has already a considerable history. Prigogine 
has discussed it in the context of structural 
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instability with respect to the appearance of 
a new species [] , but this is not related to the 
approach considered in the following. 

Moreover, since both, the initial condi- 
tions and the interaction strengths in our 
model are assumed independent of the posi- 
tion in space, the fluctuation-induced self- 
organization discussed later on must be 
distinguished from so-called "noise-induced 
transitions" as well, where we have a space- 
dependent diffusion coefficient which can in- 
duce a transition []. 

Although our model is related to dif- 
fusive processes, it is also different from 
reaction-diffusion systems that can show 
fluctuation-induced self-organization phe- 
nomena known as Turing patterns [], which 
are usually periodic in space. The noise- 
induced self-organization that we find seems 
to have (i) no typical length scale and (ii) 
no attractor, since our model is translation- 
invariant. This, however, is not yet a fi- 
nal conclusion and still subject to investi- 
gations. 

We also point out that, in the case of spa- 
tial invariance, self-organization directly im- 
plies spontaneous symmetry-breaking, and 
we expect a pronounced history-dependence 
of the resulting state. Nevertheless, when 
averaging over a large ensemble of simula- 
tion runs with different random seeds, we 
again expect a homogeneous distribution, 
since this is the only result compatible with 
translation invariance. 

Finally, we mention that our results do 
not fit into the concept of noise-induced 
transitions from a metastable disordered 
state (local optimum) to a stable ordered 
state (global optimum), which are, for ex- 
ample, found for undercooled fluids, metallic 
glasses, or some granular systems []. 



2. Discrete Model of Interactive 
Motion in Space 

Describing motion in space has the advan- 
tage that the essential variables like posi- 
tions, densities, and velocities are well mea- 
surable, which allows to calibrate, test, and 
verify or falsify the model. Although we will 
focus on motion in "real" space like the mo- 
tion of pedestrians or bacteria, our model 
may also be applied to changes of positions 
in abstract spaces, e.g. to opinion changes on 
an opinion scale []. There exist, of course, al- 
ready plenty of models for motion in space, 
and we can mention only a few []. Most of 
them are, however, rather specific for cer- 
tain systems, e.g., for fluids or for migration 
behavior. 

For simplicity, we will restrict the fol- 
lowing considerations to a one-dimensional 
space, but a generalization to higher dimen- 
sions is straightforward. The space is divided 
into / equal cells i which can be occupied by 
the entities. We will apply periodic bound- 
ary conditions, i.e. the space can be imag- 
ined as a circle. In our model, we group 
the N entities a in the system into homoge- 
neously behaving subpopulations a. If nf(t) 
denotes the number of entities of subpop- 
ulation a in cell i at time t, we have the 
relations 

J>?(t) = jv , ]Ta q = a. (l) 

i a 

We will assume that the numbers _/V a of en- 
tities belonging to the subpopulations a do 
not change. It is, however, easy to take ad- 
ditional birth and death processes and/or 
transitions of individuals from one subpop- 
ulation to another into account [] . 

In order not to introduce any bias, we 
start our simulations with a completely uni- 
form distribution of the entities in each sub- 
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population over the I cells of the system, i.e., 
n ?(0) = n hom = N a /I, for which we choose 
a natural number. At times t € {1, 2, 3, ...}, 
we apply the following update steps, using a 
random sequential update (although a par- 
allel update is possible as well, which is more 
efficient [], but normally less realistic [] due 
to the assumed synchronous updating): 

1st step: For updating of the state of en- 
tity a, given it is a member of subpopula- 
tion a and located in cell i, determine the 
so-called (expected) "success" according to 
the formula 

S a (i,t)=Y,Pabnftt) + t a {t). (2) 

b 

Here, P a b is the "payoff" in interactions of 
an entity of subpopulation a with an en- 
tity of subpopulation b. The payoff P a b is 
positive for attractive, profitable, construc- 
tive, or symbiotic interactions, while it is 
negative for repulsive, competitive, or de- 
structive interactions. Notice that P a b is as- 
sumed to be independent of the position 
(i.e., translation invariant), while the total 
payoff X)b-faf> n iM due to interactions de- 
pends on the distribution of entities over the 
system. The latter is an essential point for 
the possibility of fluctuation-induced self- 
organization. We also point out that, in for- 
mula (§), pair interactions are restricted to 
the cell in which the individual is located. 
Therefore, we do not assume spin- like or 
Ising-like interactions, in contrast to other 
quantitative models proposed for the de- 
scription of social behavior [] . 

The quantities £ a (t) are random vari- 
ables allowing to consider individual varia- 
tions of the success, which may be "real" 
or due to uncertainty in the evaluation or 
estimation of success. In our simulation pro- 
gram, they are uniformly distributed in the 
interval [0, D a ]> where D a is the fluctuation 



strength (not to be mixed up wich a diffu- 
sion constant). However, other specifications 
of the noise term are possible as well. 

2nd step: Determine the (expected) suc- 
cesses S a (i ± l,i) for the nearest neighbors 
(i ± 1) as well. 

3rd step: Keep entity a in its previous 
ceQ.i,ifS a (i,t) > max{S(i-l,t),S(i+l,t)}. 
Otherwise, move to cell (i— 1), if S(i— l,t) > 
S(i + 1, t), and move to cell (i + 1), if S(i — 
l,t) < S(i+1, t). In the remaining case S(i— 
l,t) = S(i + l,i), jump randomly to cell 
(i — I) or (i + 1) with probability 1/2. 

If there is a maximum density p max = 
N max / 1 of entities, overcrowding can be 
avoided by introducing a saturation factor 

c (j,t) = =5>*(t), 

1 * max 

a 

(3) 

and performing the update steps with the 
generalized success 

S' a (j,t)=c(J,t)S a (j,t) (4) 

instead of S a (J, t), where j e {i— + 
The model can be also easily extended to 
include long distance interactions, jumps to 
more remote cells, etc. (cf. Section 5). 

3. Simulation Results 

We consider two subpopulations a G {1,2} 
and Ni = N2 — 100 entities in each 
subpopulation, which are distributed over 
I = 20 cells. The payoff matrix (P a b) 
will be represented by the vector P = 
(P11, P12, P21, P22), where we will restrict 
ourselves to \P a b\ G {1,2} for didactical rea- 
sons. For symmetric interactions between 
subpopulations, we have P a b = Pba, while 
for asymmetric interactions, there is P a b 7^ 
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P^a, if a 7^ b. For brevity, the interac- 
tions within the same population will be 
called self-interactions, those between differ- 
ent populations cross-interactions. 

To characterize the level of self- 
organization in each subpopulation a, we 
can, for example, use the overall successes 

Sa(*) = 4EE<(*) P <^(*)' ^ 
> b 

the variances 

Va(t) = ^J2WW-<oJ 2 , (6) 

i 

or the alternation strengths 

^(*) = ^EK°(*)-<- 1 (*)] 2 - (7) 

i 

3.1. Symmetric Interactions 

By analogy with a more complicated model 
[] it is expected that the global overall suc- 
cess S(t) = ^2 a S a (t) is an increasing func- 
tion in time, if the fluctuation strengths 
D a are zero. However, what happens at 
finite noise amplitudes D a is not exactly 
known. One would usually expect that fi- 
nite noise tends to obstruct or suppress self- 
organization, which will be investigated in 
the following. 

We start with the payoff matrix P = 
(2,-1,-1,2) corresponding to positive (or 
attractive) self-interactions and negative (or 
repulsive) cross-interactions. That is, enti- 
ties of the same subpopulation like each 
other, while entities of different subpopula- 
tions dislike each other. The result will nat- 
urally be segregation ("ghetto formation") 
[], if the noise amplitude is small. However, 
segregation is suppressed by large fluctua- 
tions, as expected (see Fig. |l|). 



S3 



1 



60 



40 



20 



Subpopulation a=l 
Subpopulation a=2 



in.nini nin.ni 




15 10 15 
Cell Number 

Figure 1: Resulting distribution of 
entities at t = 4000 for the pay- 
off matrix P = (2,-1,-1,2) at 
small fluctuation strength D a = 0.1 
(top) and large fluctuations strength 
D a = 5 (bottom). 



However, for medium noise amplitudes 
D ai we find a much more pronounced self- 
organization (segregation) than for small 
ones (compare Fig. ||with Fig. Q). The effect 
is systematic insofar as the degree of segre- 
gation (and, hence, the overall success) in- 
creases with increasing noise amplitude, un- 
til segregation breaks down above a certain 
critical noise level. 

Let us investigate some other cases: 
For the structurally similar payoff matrix 
(1,-2,-2,1), we find segregation as well, 
which is not surprising. In contrast, we 
find agglomeration for the payoff matrices 
(1,2,2,1) and (2,1,1,2). This agrees with 
intuition, since all entities like each other in 
these cases, which makes them move to the 
same places, like in the formation of settle- 
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Figure 2: As Fig. [I], but with 
medium fluctuation strength D a = 
2 (top) and D a = 3 (bottom). 



ments [], the development of trail systems 
[], or the build up of slime molds []. More 
interesting is the case corresponding to the 
payoff matrix (—1, 2, 2,-1), where the cross- 
interactions are positive (attractive), while 
the self- interactions are negative (repulsive). 
One may think that this causes the entities 
of the same subpopulation to spread homo- 
geneously over the system, and in all cells 
would result an equal number of entities of 
both subpopulations, which is compatible 
with mutual attraction. However, this ho- 



mogeneous distribution turns out to be un- 
stable with respect to fluctuations. Instead, 
we find agglomeration! This result is more 
intuitive if we imagine one subpopulation 
to represent women and the other one men 
(without taking this example too serious). 
While the interaction between women and 
men is normally strongly attractive, the in- 
teractions among men or among women may 
be considered to be weakly competitive. As 
we all know, the result is a tendency of 
young men and women to move into cities. 
Corresponding simulation results for differ- 
ent noise strengths are depicted in Fig. [| 
Again, we find that the self-organized pat- 
tern is destroyed by strong fluctuations in 
favour of a more or less homogeneous distri- 
bution, while medium noise strengths fur- 
ther self-organization. 

For the payoff matrices (—2, 1, 1, —2) and 
(— 2, — 1, — 1, — 2), i.e. cases of strong neg- 
ative self-interactions, we find a more or 
less homogeneous distribution of entities 
in both subpopulations, irrespective of the 
noise amplitude. In contrast, the payoff ma- 
trix (—1,-2,— 2,-1) corresponding to nega- 
tive self-interactions but even stronger nega- 
tive cross-interactions, leads to another self- 
organized pattern. We may describe it as the 
formation of lanes, as it is observed in pedes- 
trian counterflows [] or in sheared granu- 
lar media with different kinds of grains []. 
While both subpopulations tend to separate 
from each other, at the same time they tend 
to spread over all the available space (see 
Fig. [|) , in contrast to the situation depicted 
in Figs. |] and @. Astonishingly enough, a 
medium level of noise again supports self- 
organized ordering, since it helps the sub- 
populations to separate from each other. 

We finally mention that a finite satu- 
ration level suppresses self-organization in 
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Figure 3: As Fig. [|, but for the pay- 
off matrix P = (-1,2,2,-1) and 
D a = 0.05 (top), D a = 1.5 (middle), 
and D a — 5 (bottom). 



a surprisingly strong way, as is shown in 
Fig. ||. Instead of pronounced segregation, 
we will find a result similar to lane forma- 
tion, and even strong agglomeration will be 
replaced by an almost homogeneous distri- 
bution. 
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Figure 4: As Fig. [I], but for the 

payoff matrix P = (-1, -2, -2, -1) 
and D a = 0.05 (top), D a = 0.5 
(middle), and D a — 5 (bottom). 



Noise-induced ordering 

A possible interpretation for noise-induced 
ordering would be that fluctuations allow 
the system to leave local minima (corre- 
sponding to partial agglomeration or segre- 
gation only). This could trigger a transition 
to a more stable state with more pronounced 
ordering. However, although this interpre- 
tation is consistent with a related example 
discussed in Ref. [], the idea of a step- wise 
coarsening process is not supported by the 
temporal evolution of the distribution of en- 
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Figure 5: Resulting distribution of 
entities at t = 4000 with satura- 
tion level iV max = 50. Top: P = 
(2,-1,-1,2) and D a = 3. Bottom: 
P = (-1, 2, 2, -1) and £> a = 1.5. 



tities (see Fig. |6|) and the time-dependence 
of the overall success within the sub-popula- 
tions (see Fig. fj]). This idea is anyway not 
applicable to segregation, since, in the one- 
dimensional case, the repulsive clusters of 
different subpopulations cannot simply pass 
each other in order to join others of the same 
subpopulation. 

According to Figs. || and 0, segregation 
and agglomeration rather take place in three 
phases: First, there is a certain time in- 
terval, during which the distribution of en- 
tities remains more or less homogeneous. 
Second, there is a short period of rapid 
self-organization. Third, there is a contin- 
uing period, during which the distribution 
and overall success do not change anymore. 
The latter is a consequence of the short- 
range interactions within our model, which 



are limited to the nearest neighbors. There- 
fore, the segregation or aggregation process 
practically stops, after separate peaks have 
evolved. This is not the case for lane forma- 
tion, where the entities redistribute, but all 
cells remain occupied, so that we have on- 
going interactions. This is reflected in the 
non-stationarity of the lanes and by the os- 
cillations of the overall success. 
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Figure 6: Temporal evolution of 
the distribution of entitities within 
subpopulation a = 2 for P = 
(2,-1,-1,2) and D a = 3 (top), 
P = (-1,2,2,-1) and D a = 1.5 
(middle), and P = (-1, -2, -2, -1) 
and D a = 0.5 (bottom). 

We suggest the following interpretation 
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for the three phases mentioned above: Dur- 
ing the first time interval, which is char- 
acterized by a quasi-continous distribution 
of entities over space, a long-range pre- 
ordering process takes place. After this 
"phase of preparation" , order develops in 
the second phase similar to crystallization, 
and it persists in the third phase. The role 
of fluctuations seems to be the following: 



An increased noise level avoids a rash lo- 
cal self-organization by keeping up a quasi- 
continuous distribution of entities, which 
is required for a redistribution of entities 
over larger distances. In this way, a higher 
noise level increases the effective interac- 
tion range by extending the first phase, the 
"interaction phase" . As a consequence, the 
resulting structures are more extended in 
space (but probably without a characteristic 
length scale, see Introduction). 

It would be interesting to investigate, 
whether this mechanism has something to 
do with the recently discovered phenomenon 
of "freezing by heating" , where a medium 
noise level causes a transition to a highly 
ordered (but energetically less stable) state, 
while extreme noise levels produce a disor- 
dered, homogeneous state again []. 

3.2. Asymmetric Interactions 

Even more intriguing transitions than in 
the symmetric case can be found for asym- 
metric interactions between the subpopula- 
tions. Here, we will focus on the payoff ma- 
trix (—1,2,-2,1), only. This example cor- 
responds to the curious case, where indi- 
viduals of subpopulation 1 weakly dislike 
each other, but strongly like individuals of 
the other subpopulation. In contrast, indi- 
viduals of subpopulation 2 weakly like each 
other, but they strongly dislike the other 
subpopulation. A good example for this is 
hard to find. With some good will, one may 
imagine subpopulation 1 to represent poor 
people, while subpopulation 2 corresponds 
to rich people. What will be the outcome? 
In simple terms, the rich are expected to 
agglomerate in a few areas, if the poor are 
moving too nervously (see Fig. |8|). In detail, 
however, the situation is quite complex, as 
discussed in the next paragraph. 
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Noise-induced self-organization 

At small noise levels D a , we will just find 
more or less homogeneous distributions of 
the entities. This is already different from 
the cases of agglomeration, segregation, and 
lane formation we have discussed before. 
Self-organization is also not found at higher 
noise amplitudes D a , as long as we assume 
that they are the same in both subpop- 
ulations (i.e., D\ = D 2 ). However, given 
that the fluctuation amplitude D 2 in sub- 
population 2 is small, we find an agglomer- 
ation in subpopulation 2, if the noise level 
D\ in subpopulation 1 is medium or high, 
so that subpopulation 1 remains homoge- 
neously distributed. The order in subpop- 
ulation 2 breaks down, as soon as we have 
a relevant (but still small) noise level D 2 in 
subpopulation 2 (see Fig. ||). 

Hence, we have a situation where asym- 
metric noise with D\ ^ D 2 can facili- 
tate self-organization in a system with com- 
pletely homogeneous initial conditions and 
interaction laws, where we would not have 
ordering without any noise. We call this phe- 
nomenon noise-induced self-organization. It 
is to be distinguished from the noise-induced 
increase in the degree of ordering discussed 
above, where we have self-organization even 
without noise, if only the initial conditions 
are not fully homogeneous. 

The role of the noise in subpopulation 

1 seems to be the following: Despite of the 
attractive interaction with subpopulation 2, 
it suppresses an agglomeration in subpopu- 
lation 1, in particular at the places where 
subpopulation 2 agglomerates. Therefore, 
the repulsive interaction of subpopulation 

2 with subpopulation 1 is effectively re- 
duced. As a consequence, the attractive 
self-interaction within subpopulation 2 dom- 
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inates, which gives rise to the observed ag- 
glomeration. 

The temporal development of the distri- 
bution of entities and of the overall success 
in the subpopulations gives additional in- 
formation (see Fig. ^J). As in the case of 
lane formation, the overall success fluctuates 
strongly, because the subpopulations do not 
separate from each other, causing ongoing 
interactions. Hence, the resulting distribu- 
tion is not stable, but changes continuously. 
It can, therefore, happen, that clusters of 
subpopulation 2 merge, which is associated 
with an increase of overall success in sub- 
population 2 (see Fig. ||). 
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Figure 9: Temporal evolution of the 
distribution of entitities within sub- 
population a = 2 (top) and of the 
overall successes (bottom) for P = 
(-1,2,-2,1) and D 1 = 50, D 2 = 
0.5. 



4. Conclusions 

We have proposed a game theoretical model 
for self-organization in space, which is ap- 
plicable to many kinds of biological, eco- 
nomic, and social systems with various types 
of profitable or competitive self- and cross- 
interactions between subpopulations of the 
system. Depending on the structure of the 
payoff matrix, we found several different 
self-organization phenomena like agglom- 
eration, segregation, or lane formation. It 
turned out that medium noise strengths 
can increase the resulting level of order, 
while a high noise level leads to more or 
less homogeneous distributions of entities 
over the available space. The mechanism 
of noise-induced ordering in the above dis- 
cussed systems with short-range interac- 
tions seems to be the following: Noise ex- 
tends a "pre-ordering" phase by keeping 
up a quasi-continuous distribution of enti- 
ties, which allows a long-range ordering. For 
asymmetric payoff matrices, we can even 
have the phenomenon of noise-induced self- 
organization, although we start with com- 
pletely homogeneous distributions and ho- 
mogeneous (translation-invariant) payoffs. 
However, the phenomenon requires different 
noise amplitudes in both subpopulations. 
The role of noise is to suppress agglomer- 
ation in one of the subpopulations, in this 
way reducing repulsive effects that would 
suppress agglomeration in the other subpop- 
ulation. 

We point out that all the above results 
can be semi-quantitatively understood by 
means of a linear stability analysis of a 
related continuous version of the model 
[]. This continuous version indicates that 
the linearly most unstable modes are the 
ones with the shortest wave length, so that 
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one does not expect a characteristic length 
scale in the system. This is different from 
reaction-diffusion systems, where the most 
unstable mode has a finite wave length, 
which gives rise to the formation of periodic 
patterns. Nevertheless, the structures evolv- 
ing in our model are spatially extended, but 
non-periodic. The spatial extension is in- 
creasing with the fluctuation strength, un- 
less a critical noise amplitude is exceeded. 

For a better agreement with real sys- 
tems, the model can be generalized in many 
ways. The entities may perform a biased or 
unbiased random walk in space. One can al- 
low random jumps to neigboring cells with 
some prescribed probability. This probabil- 
ity may depend on the subpopulation, and 
thus we can imitate different mobilities of 
the considered subpopulations. Evolution is 
slowed down by introducing a threshold, 
fixed or random, so that the entities change 
to other cells only if the differences in the 
relevant successes are bigger than the im- 
posed threshold. The model can be also gen- 
eralized to higher dimensions, with expected 
interesting patterns of self-organized struc- 
tures. 

In general, the random variables £ Q (t) in 
the definition of the success functions can be 
allowed to have different variances for the 
considered cell i and the neighboring cells, 
with the interpretation that the uncertainty 
in the evaluation of the success in the consid- 
ered cell is different (e.g. smaller) than that 
in the neighboring cells. Moreover, the un- 
certainties can be different for various sub- 
populations, which could reflect to some ex- 
tent their different knowledge and behavior. 

One can as well study systems with more 
than two subpopulations, the influence of 
long-range interactions, etc. The entities can 
also be allowed to jump to more remote cells. 



As an example, the following update rule 
could be implemented: Move entity a from 
cell i to the cell (i + I) for which 

SZ(i + l,t) = d^c(i + l,t)S a (i + l,t) (8) 

is maximal = 0, 1, Z max ). If there arc 
m cells in the range {(x — ?max), ■ ■ ■ ,(x + 
^max)} with the same maximal value, choose 
one of them randomly with probability 1/m. 
According to this, when spontaneously mov- 
ing to another cell, the entity prefers cells in 
the neighborhood with higher success. The 
indirect interaction behind this transition, 
which is based on the observation or esti- 
mation of the success in the neighborhood, 
is short-ranged if Z max <C I, otherwise long- 
ranged. Herein, l max denotes the maximum 
number of cells which an entity can move 
within one time step. The factor containing 
d with < d < 1 allows to consider that it 
is less likely to move for large distances, if 
this is not motivated by a higher success. A 
value d < 1 may also reflect the fact that 
the observation or estimation of the success 
over large distances becomes more difficult 
and less reliable. 
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